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ABSTRACT 


Distributed  decision  problems  arise  whenever  two  or  more 
sensors  and  their  associated  computers  must  work  coopera¬ 
tively  to  make  a  decision  about  a  commonly  observed  event. 
Typical  examples  are  in  target  detection  and  classification. 
The  problem  is  usually  characterized  by  a  limited  bandwidth 
of  the  communication  link  between  the  sensors. 

This  thesis  develops  and  evaluates  an  algorithm  for 
distributed  decision  and  compares  it  to  a  non-distributed  or 
centralized  form  of  the  algorithm.  Analysis  of  the  algo¬ 
rithm  is  carried  out  for  some  low-dimensional  cases. 
Computer  simulations  were  carried  out  for  higher  dimensional 
cases.  The  simulation  work  was  done  in  Fortran  under  CMS  on 
an  IBM  370/3033  computer. 
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I.  INTRODUCTION 

A.  GENERAL  DISCUSSION 

This  thesis  presents  an  algorithm  for  distributed 
decision  and  compares  its  performance  to  that  of  a 
centralized  decision  rule.  A  distributed  decision  rule  is 
characterized  by  the  fact  that  a  decision  algorithm  is 
distributed  between  processors  of  two  or  more  sensors. 

For  simulation  and  evaluation,  some  programs  were 
written  in  Fortran  on  an  IBM  770/3033  computer.  The  work  of 
this  thesis  is  concerned  with  the  analysis  of  the 
distributed  decision  rule  only.  A  related  thesis  by  Capt . 
Mark  Schon  [Ref.  1]  is  concerned  with  the  implementation  in 
real  time  on  a  distributed  microcomputer  system. 

The  specific  goals  of  this  thesis  are  to  : 

1  Develop  and  analyze  a  specific  distributed  decision 
algorithm. 

2  Generate  all  necessary  data,  parameters  and  statistics 
to  simulate  the  decision  algorithms. 

3  Experimentally  evaluate  the  capabilities  and 
performance  of  a  distributed  decision  rule  and  compare 
it  with  a  centralized  decision  rule. 


B.  BACKGROUND 

In  this  thesis  statistical  methods  are  used  to  develop 
decision  algorithms.  Since  we  deal  with  many  observations 
which  represent  data  collected  by  the  sensors,  vector 
notation  and  matrix  algebra  is  used  extensively  in  these 
algorithms . 

The  Gaussian  distribution  is  used  to  characterize  the 
observations  because  this  provides  a  decision  rule  that  is 
relatively  easy  to  analyze  and  develop  intuition.  It  also 
provides  a  reasonable  decision  rule  based  on  second  moment 
statistics  (mean  and  covariance)  of  the  observation  data. 


Bayes's  rule  is  used  to  develop  decision  algorithms  for 
binary  decision  (class  1  or  class  2)  and  to  develop  the 
decision  boundary  concept.  Mathematical  manipulation  of 
Bayes’s  rule  leads  to  specific  decision  algorithms  which  are 
analyzed  and  evaluated  in  the  computer  simulation. 

Since  it  is  very  difficult  to  visualize  decision 
boundaries  in  high  dimehsional  spaces,  we  have  developed 
some  computer  programs  to  experimentally  evaluate  the 
algorithms.  The  simulations  show  that  in  many  cases  the 
distributed  decision  algorithms  are  quite  reliable  and 
perform  nearly  as  well  as  a  centralized  decision  algorithm. 

C.  STRUCTURE  OF  THE  THESIS 

The  remainder  of  this  thesis  is  structured  as  follows. 
Chapter  II  addresses  the  overall  processes  of  the  decision 
rule  including  probability  laws  for  random  vectors  and  Bayes 
decision  theory.  The  matrix  algebra  needed  to  describe  this 
is  also  developed.  Decision  rules  are  interpreted  as 
providing  boundaries  and  regions  in  a  multidimensional  space 
that  determine  decisions  made  about  the  observed  data. 

Chapter  III  describes  a  distributed  decision  algorithm 
and  the  form  of  its  decision  boundary.  Detailed  analysis 
and  evaluation  are  given  comparing  it  with  the  centralized 
decision  rule. 

Chapter  IV  presents  computer  simulations  to  test  the 
distributed  decision  rules.  To  simulate  data  collected  by 
sensors,  an  autoregressive  time  series  model  is  introduced. 
Second  moment  statistics  i.e.  the  mean,  variance  and 
covariance  of  the  given  random  vectors  are  computed  by  a 
statistical  estimation  algorithm.  These  statistics  are 
further  used  to  compute  the  algorithm  parameters.  Decision 
algorithms  are  tested  with  the  generated  data  and  results 
are  given. 

Chapter  V  summarizes  the  results  of  the  thesis  and 
describes  the  capabilities  and  performance  of  the  decision 
algorithms.  Suggestions  are  also  given  for  future  research. 


II.  BASIC  DECISION  PROCESSES 


A.  CLASS  DECISION 

Class  decision  means  a  classification  of  objects  into 
categories.  The  objects  of  interest  may  be  radar  targets, 
electronic  waveforms  or  signals,  printed  letters  or 
characters,  states  of  a  system,  or  any  number  of  other 
things  that  are  desired  to  be  classified. 


Figure  2.1  Basic  Class  Decision  Procedure 

In  testing  a  class  decision  algorithm  the  individual 
classes  of  objects  are  presumed  already  known.  The  basic 
procedure  for  a  class  decision  is  illustrated  in  Fig.  2.1. 
A  portion  of  a  known  set  of  labeled  objects  is  extracted  and 
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objects  in  the  test  set  are  known.  The  result  of 
classification  is  supervised  by  a  teacher  who  may  dictate 
suitable  modifications  to  the  algorithm. 

A  simple  example  of  a  class  decision  is  presented  to 
illustrate  its  approach  and  to  define  some  relevant 
concepts.  Fig.  2.2(a)  illustrates  32-dimensional 
observations  of  electronic  waveforms.  The  vector  Xg  is 
called  the  observation  vector  and  the  multidimensional  space 
in  which  it  resides  is  called  the  observation  space.  These 
are  depicted  in  Fig.  2.2(b)  and  (c). 

Every  problem  in  class  decision  has  at  least  two  things 
in  common.  First,  an  exact  description  of  the  various 
classes  of  objects  cannot  be  obtained.  Thus  the  class 
decision  is  inherently  a  probabilistic  topic.  Secondly,  the 
objects  are  represented  by  vectors  in  a  multidimensional 
space.  Thus  the  observation  vectors  of  the  objects  to  be 
classified  are  multidimensional  random  vectors  which  must  be 
described  in  a  statistical  sense.  Similarly,  the 
performance  of  the  algorithm  must  also  be  measured  in  a 
statistical  sense.  Thus  an  adequate  background  in 
probability  and  statistics  is  important  for  these  problems. 

B.  THE  GAUSSIAN  DISTRIBUTION  FOR  RANDOM  VECTORS 

In  engineering  and  many  other  areas,  the  Gaussian 
distribution  is  frequently  encountered.  It  describes 
certain  phenomena  well  with  just  two  parameters,  namely  the 
mean  and  the  covariance  of  the  random  variables.  The 
Gaussian  density  function  for  one-dimensional  random 
variables  is: 


In  the  two-dimensional  case  (i.e.  two  random  variables) 
the  Gaussian  density  function  is: 


Fig.  2.4  shows  a  two-dimensional  density  function  p„  „(x,y) 

o’*'  O 

with  its  mean  values  m^^  and  my,  its  variances  and  Oy 

and  the  correlation  coefficient  p  of  both  random  variables 
X  and  y  [Ref.  2:  p.  158]. 
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Figure  2.4  Two-Dimensional  Gaussian  Density  Function 

The  Gaussian  density  function  for  two  sets  of 
multidimensional  random  variables  x  and  y  is  expressed  by 
the  combined  vector  z  and  its  parameters  as  follows: 


A 


where 


.K'"- 


K(*) 

*^2  ^zy 

B(Or  K  (’) 

"ly 


.=1,2  (2.4) 


Observation  vectors  x  and  y  are  N  and  M- dimensional 
respectively.  The  mean  vectors  irij^  and  niy  are  also  N  and  M 
dimensional,  and  they  represent  the  expectations  of  vectors 
i.e.  Sx  ~  E[(x)]  and  my  =  E[(2)].  The  covariance  matrices 
[K„]  and  [K^]  are  of  size  [N  X  N]  and  [M  x  M]  respectively 
and  represent  correlations  among  the  components  of  x  and 
The  matrix  [B„„]  is  of  size  [N  x  M]  and  represents  cross 
correlation  between  the  components  of  the  vectors  x  and 
These  matrices  are  also  defined  by  expectations  of  vectors 
i.e.  =  E[(x-mjj)  (x-rajj)"^]  ,  Ky  =  E[ (j-my)  (y-niy )^]  ,  and 

Bjjy  =  E[(x-mjj)  (^-niy)'^]  . 

C.  BAYES'S  THEOREM 

Bayes's  theorem  is  used  to  convert  prior  probabilities 
into  posterior  probabilities.  The  form  of  this  theorem  that 
is  useful  to  us  is: 


Pr  (  I  jL  )  = 


p  (_z  I  u;  )p,  (  u;  ) 
P(j£  ) 


(2.5) 


where  w  represents  an  event  such  as  "object  belongs  to 
class  1".  The  term  Pj.(a))  is  called  the  prior  probability 
of  the  event  and  the  term  Pj.((olx)  is  called  the  posterior 

probability.  More  generally,  let  c«;2>  .  >  be 

n  mutually  exclusive  classes  exhausting  the  set  of  all 


possible  classes  of  the  objects.  Then  the  conditional 
probability  law  gives  this  following  equation: 


,  ,  ,  P{JL  \  )Pr( 


(2.6) 


n 

where  p(x)  =  S  p(x |  Wi )Pr (w,  ) .  If  we  consider  the  case 
where  observations  consist  of  two  vectors  x  and  jr  and  assume 
that  there  are  only  two  classes,  class  l(a>i)  and  class 
2(6)2)*  above  equation  becomes: 


Pr  (  I  )  = 


P^,Ji\u.ijL^JL  \  <^1  )Pr(  ) 

Pz,A^>JL  ) 


,  1=1,2  (2.7) 


If  we  make  a  class  decision  based  on  the  posterior 
probabilities,  that  is 


Pr  (  ‘*^1  I  JL'JL  )  <  Pr  (  ‘*'2  1  JL'JL  ) 


(2.8) 


then  Eqs.  2.7  and  2.8  lead  to  the  likelihood  ratio  test 


,  Pl(^jL  )  >  Pr(  ^2  ) 

—  ^  P2(jL’J'.  )  ^  Pr  (  ) 


(2.9) 


where  we  have  used  the  notation  Pi(x,X.)  to  represent  the 
class  conditional  density  p(x,^la;,).  If  the  likelihood 


ratio  l(x,y)  for  specific  observation  vectors  x  and  y  is 
greater  than  a  threshold  value  T  then  class  l(w]^)  is 
chosen.  On  the  other  hand  if  the  ratio  is  less  than  T  class 
chosen. 

D.  DECISION  BOUNDARY  OF  CENTRALIZED  DECISION  RULE 

Although  any  decision  rule  for  our  problem  is  at  least 
two-dimensional,  corresponding  to  observations  x  and  y,  it 
is  still  instructive  to  look  at  the  likelihood  ratio  for  a 
single  variable  x.  The  decision  boundary  of  a 
one-dimensional  case  is  relatively  simple  as  Fig.  2.5  shows. 


Figure  2.5  Decision  Boundary  of  One-Dimensional  Case 

The  decision  boundary  is  just  given  as  a  set  of  points  on 
the  X  axis. 
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In  the  two-dimensional  case  the  decision  boundary  is 
more  complicated.  For  Gaussian  random  vectors  it  could  be  a 
straight  line,  ellipse,  hyperbola,  parabola  or  a 
combination. 


Figure  2.6  Decision  Boundary  of 
Two-Dimensional  Case  (Hyperbola) 

Fig.  2.6  shows  an  example,  if  observation  variables  x  and  y 
are  outside  the  curve  lines  i.e.  in  region  1(R]^)  the 
decision  is  class  1,  if  inside  i.e.  in  region  2(R2)  the 
decision  is  class  2. 

When  the  dimension  of  the  observations  is  more  than  two, 
it  is  more  difficult  to  visualize  the  decision  boundary  but 
the  concept  is  still  useful.  A  centralized  decision  rule 
uses  the  x  and  y  vectors  together  directly  in  its  algorithm. 


III.  DISTRIBUTED  DECISION  RULE 


A.  BACKGROUND 


The  AEGIS  weapons  system  simulation  project,  currently 
being  conducted  at  the  Naval  Postgraduate  School,  is 
attempting  to  determine  the  feasibility  of  replacing  the 
larger  and  relatively  expensive  mainframe  computer,  the 
AN/UYK-7,  with  a  system  of  16  or  32  bit  VLSI  computers  [Ref. 
3]. 
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Figure  3.1  Distributed  Decision  Scenario 


As  the  capabilities  and  performance  of  microcomputers 
continue  to  improve,  it  is  becoming  apparent  that  an 
integrated  multiprocessor  system  of  less  expensive,  compact 
microcomputers  can  manage  many  real-time  applications  that 
have  previously  used  mainframe  computers.  This  set  of 


microcomputers  has  been  used  to  demonstrate  our  distributed 
decision  rule  in  a  realistic  environment [Ref .  1].  The 

computers  have  been  organized  to  simulate  two  sensors 
observing  the  same  object  for  purposes  of  detection  and/or 
classification. 

As  illustrated  in  Fig.  3.1,  sensor  A  deals  with  the 
observation  vector  only,  while  sensor  B  deals  with  the 
observation  vector  exclusively.  A  centralized  decision 
rule  uses  both  observation  vectors  x^  and  y^  at  once  in  a 
single  processor  to  determine  its  decision.  In  a 
distributed  decision  procedure,  each  processor  cannot  use 
both  vectors  together  because  of  the  limited  bandwidth 
communication.  Nevertheless,  by  exchange  of  some  minimum 
essential  information,  each  processor  makes  a  decision  which 
is  quite  reliable.  The  concepts  will  be  developed 
mathematically  in  this  chapter  and  tested  experimentally  in 
the  following  chapter. 

B.  DEFINITION 

In  order  to  introduce  the  concepts  of  three  decision 
algorithms  here  each  algorithm  is  presented  mathematically. 

These  algorithms  are: 

1  Centralized  Decision  Algorithm  (C.D.A) 

2  Distributed  Decision  Algorithm  A  (D.D.A) 

3  Distributed  Decision  Algorithm  B  (D.D.B) 


1 .  Centralized  Decision  Algorithm 

The  concept  of  a  likelihood  ratio  was  introduced  in 
Chapter  2  Section  C.  From  the  likelihood  ratio  the 
centralized  decision  rule  is  derived.  The  likelihood  ratio 
for  Gaussian  data  is  expressed  (using  Eq .  2.3  and  Eq .  2.9) 
as  follows: 


22 


/(j.)  = 


P\{± ) 
P2(_L  ) 


-  i  (i  -  2*"  j. 


-  T  (j.  - 

m 


(3.1} 


>  Pr(  ^^2  )  ^ 

<  Pr  (  ) 

“J 

where  vector  z,  and  matrix  were  introduced  in 

Eq.  2.4.  Here  the  subscript  1  and  2  means  class  1  and  class 
2  respectively  in  the  two  class  case.  Taking  the  natural 
logarithm  of  both  sides  of  Eq.  3.1  yields  this  following 
centralized  decision  algorithm: 


-  ( _£_  -  m*'*  )  +  In 


(3.2) 


Such  a  centralized  decision  procedure  is  shown  in  Fig.  3.2. 


Decision  Aleorithm  into 


onencs 


Although  Eq .  3.2  adequately  represents  the 

centralized  decision  rule,  we  want  to  put  it  in  a  form 
involving  vectors  separately  and  certain  partitions 

of  the  matrices  m^^\  and  m(^)  for  the  two 

classes.  This  will  help  us  to  develop  the  distributed 
decision  rules  and  enable  us  to  more  directly  compare  the 
distributed  rules  to  the  centralized  rule.  Fig.  3.2  shows  a 
scenario  using  both  observation  vectors  in  a  centralized 
processor.  To  develop  a  distributed  form  of  the  decision 
algorithm,  we  proceed  as  follows.  Using  a  conditional 
probability  law  the  joint  probability  p(x,^)  is  equivalent 


CENTRALIZED  PROCESSOR 


Figure  3.2  Centralized  Decision  Scenario 


Taking  the  log  base  e  of  both  sides  leads  to: 


Eq.  3.4  shows  how  the  probability  density  can  be  distributed 
into  two  parts,  where  one  part  is  a  function  of  x  only  and 
the  other  part  is  a  function  of  y  given  jc.  For  the  Gaussian 
case  the  probability  density  function  of  random  vector  x  is; 
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The  conditional  probability  density  function  of  vector  ^ 
given  x[Ref.  2]  is: 
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where 
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In  Eqs.  3.7  and  3.8,  [Kyjjj]  and  niy  |  is  easily 
calculated  using  all  parameters  and  both  observation  vectors 
Q  and  Xq  directly.  Thus  the  conditional  probability 
density  function  p(i|x)  is  determined  without  any 
difficulties.  Using  the  above  expressions  Eqs.  3.5  and  3.6, 
Eq .  3.1  becomes ; 
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Finally  by  taking  the  natural  logarithm  of  both  sides,  Eq 
3 . 9  becomes : 
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Eq.  3.10  suggests  a  distributed  form  for  the  decision  rule 
which  is  described  in  the  next  section. 

3.  Distributed  Decision  Rule  A 


Fig.  3.1  shows  that  processor  A  uses  vector  x^  only 
and  processor  B  uses  vector  only.  In  this  distributed 
decision  rule  the  processor  A  which  is  to  compute 
has  no  problem  because  it  observes  vector  _Xq  directly  and  it 
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has  all  the  other  parameters  needed  in  Eq.  3.11.  Processor 
B,  which  is  to  compute  Xb^^oI^o^*  ^  problem  however 
because  it  does  not  have  direct  access  to  .  This  other 
observation  vector  appears  in  Eq.  3.8;  thus  Eq.  3.12  is 
dependent  on  . 

If  there  exists  a  way  to  estimate  the  observation 
vector  Xq  using  known  parameters  and  sensor  B's  own 
observation  vector  then  the  estimated  x  which  we  denote 
by  can  be  used  in  Eq.  3.8  instead  of  x^  itself.  This 
procedure  is  known  as  a  generalized  likelihood  ratio  test 
[Ref.  4] .  In  this  case  sensor  B  will  have  no  problem  in  the 
computation  since  it  is  assumed  that  the  other  parameters 
necessary  to  compute  niy  |  ^  ^y  1  x  already  known. 

To  obtain  an  estimate  processor  B  considers  the 
following  conditional  density: 


P.  ( I  X  )  = 
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exp 


(3.13) 
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In  particular  processor  B  chooses  x  as  the  value  that 
maximizes  Pi(x|j;f).  Because  of  its  Gaussian  form,  Eq .  3.13 
is  maximized  when  x  =  nij^jy.  From  the  symmetry  of  Eqs .  3.6 
and  3.13  the  following  estimate  is  obtained(see  Eq .  3.8). 


X,  =  m. 


(;•>  =  m,(’)  +  Bi;)  [y,-  ^f-)]  .  ,-  =  1.2  (3.14) 
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Now  processor  B  can  use  x  which  is  calculated  by 
known  parameters  nij^,  [B^y]  .  [Ky]  .  Ey*  and  its  own 
observation  vector  ^  in  Eq.  3.10  to  implement  a  distributed 
decision  algorithm.  In  this  algorithm  Eq.  3.10  is  modified 
to  the  form: 


^  A  (£.0)  fl  (jLo)  <  ^ 


(3.15) 


where 


^b{}Lo)  ~ 


(3.16) 


and  where  XB^yolSi^  given  by  Eq.  3.12  with  x^  replaced 
by  of  Eq.  3.14.  Specifically  will  be  used  in  the 
computation  of  and  will  be  used  in  the 

computation  of  S'  'y|x  as  these  terms  appear  in  Eq .  3.12. 

The  terra  A^(Xg)  is  exactly  the  sarae  as  in  Eqs .  3.10  and 
3.11. 

Let  us  suramarize  the  the  results  as  follows.  In 
this  distributed  decision  rule  A  A^(Xq)  is  the  sarae  as  was 
shown  in  the  centralized  decision  rule  of  Eq.  3.10.  However 
is  different  from  Xb^^oI^o^  centralized 

decision  rule.  Actually  X'B(yo^  siraplified  notation 

for  the  term  XB(yol^i)-  ^^(Xo)  and  A'B(yo) 

single  statistics  which  must  be  added  together  and  compared 
to  the  threshold  value  T  to  decide  the  class  of  the  observed 
object.  These  statistics  Xa,(’^o^  X'B(yo) 

displayed  in  Eq .  3.11  and  3.16. 


SENSOR  A 


SENSOR  B 


Figure  3.3  Block  Diagram  of  Distributed  Decision 
Algorithms  (a)  Type  A(D.D.A)  (b)  Type  B(D.D.B) 
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The  single  statistic  X'sCyg)  which  is  calculated 
in  processor  B  is  transmitted  to  processor  A  through  the 
limited  bandwidth  communication  link.  Processor  A  will  then 
have  both  its  own  calculated  statistic  ^a^-o^ 
statistic  X'B(yo)  received  from  processor  B.  Therefore  it 
can  decide  the  class  of  observed  object  using  Eq.  3.15.  Eq. 
3.15  is  called  distributed  decision  rule  A  because  the  class 
decision  is  made  in  processor  A.  This  algorithm  is 
illustrated  in  Fig.  3.3  (a). 

4 .  Distributed  Decision  Rule  B 

Distributed  decision  rule  A  was  considered  in  the 
previous  section.  A  symmetric  form  of  this  algorithm  is 
illustrated  in  Fig.  3.3(b).  This  algorithm  uses  a  symmetric 
form  of  the  conditional  probability  law  of  Eq.  3.3. 


P.  ( ±^1.  )  =  Pi  ( X  )  P.  ( Z.  I  X  )  ’  »  = 


(3.17) 


which  leads  to: 
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By  analogy  and  symmetry  with  the  equations  used  in 
distributed  decision  algorithm  A,  the  following  algorithm  is 
derived 
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where  K^^jy  and  nj^iy  computed  from  equations  analogous  to 
Eqs.  3.7  and  3.8.  Processor  B  calculates  the  single 
statistic  using  its  own  observation  vector  y^. 
Processor  A  computes  the  single  statistic  ^A^-o^  using 
the  following  estimate  for  the  vector  y: 


Thus  ^  simplified  notation  for  ^A^Sol^i^ 

is  transmitted  to  processor  B  through  the  communication 
link.  Therefore  processor  B  computes  AgCYo)  locally  and 
receives  ^  A^iSo^  from  processor  A.  Then  processor  B  makes 
a  decision  about  the  class  of  the  observed  object  using  Eq . 
3.19.  This  procedure  represents  distributed  decision  rule  B 
because  the  class  decision  is  made  by  processor  B. 

C.  COMPARISON  WITH  THE  CENTRALIZED  DECISION  RULE 

Three  algorithms  were  introduced  and  explained  in  the 
previous  sections  A  and  B.  Table  1  shows  the  differences 
among  them  very  briefly.  Notice  that  the  two  forms  (Type  A 
and  Type  B)  given  for  the  centralized  decision  rule  are 
equivalent.  In  distributed  decision  algorithm  A,  processor 
B  uses  the  estimated  value  instead  of  the  observed  value 
x^  and  sends  the  result  processor  A.  In 

distributed  decision  algorithm  B,  processor  A  uses  "y^i^ 
instead  of  y^  and  sends  A’aC^q^  These  differences 

are  visualized  simply  in  Table  2. 

Use  of  the  estimates  in  distributed  decision 

algorithm  A,  and  in  distributed  decision  algorithm  B 

makes  the  results  of  these  algorithms  different  from  each 
other  and  different  from  the  centralized  decision  rule. 

Further,  the  use  of  rules  A  and  B  together  can  result  in  an 
ambiguous  situation  where  the  two  decisions  are  different. 
This  can  be  resolved  in  a  number  of  ways  discussed  later. 

The  key  components  which  make  the  algorithms  different 
from  one  another  are  the  use  of  the  estimate  Xj^  in 
distributed  decision  algorithm  A,  and  in  distributed 

decision  algorithm  B.  If  the  estimated  vectors  x^  and  y^ 
are  close  to  the  actual  observation  vectors  x^  and  y^ 
respectively  then  the  results  of  the  distributed  algorithms 
A  and  B  would  be  close  to  each  other  and  close  to  the 
centralized  algorithm.  Although  we  have  not  been  able  to 
characterize  theoretically  the  relative  performance  of  these 
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DIFFERENCES  AMONG  THREE  ALGORITHMS 


PROCESSOR  B  USING  x  AND  v 
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IV.  SIMULATION 


This  chapter  contains  an  evaluation  and  comparison  of 
distributed  decision  rules  A  and  B,  and  the  centralized 
decision  rule.  The  generation  of  random  observation  vectors 
and  the  calculation  of  their  resulting  statistics  are 
discussed  in  sections  A  and  B.  In  section  C  the  results  of 
the  decision  algorithms  are  compared  to  the  results  obtained 
from  classification  using  a  centralized  algorithm. 

A.  RANDOM  VECTOR  GENERATION 

The  observation  vectors  x  and  ^  ^.re  generated  by  using  a 
linear  difference  equation  with  white  noise  excitation. 
This  difference  equation  can  model,  for  example,  the  time 
series  of  radar  cross  section  values  that  result  when  the 
target  is  observed  by  the  sensors  over  a  relatively  short 
period  of  time.  If  and  W2  are  independent  white  noise 
processes  this  difference  equation  has  the  form; 


x'{  I  ) 
y'(  /  ) 

=  ^1 

x'(I  -l) 
y'(  /  -  1  ) 

+  A  2 

x’{I  -2) 
y\l  -2) 

X  {  I  -  p  ) 

y  {  ^  -  p  ) 

+  k/ 
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/  ) 

where 


This  generates  a  pair  of  time  series  for  x  and  y  that  are 
correlated  and  have  zero  mean.  The  measurements  x  and  v 
that  represent  the  observations  are  then  defined  by: 


r  (  /  )  + 

ly(n  1 

y  (  /  )  + 

where  m^^  and  lUy  are  the  mean  values  of  the  observations. 
The  observation  vectors  x  and  ^  then  represent  n  samples  of 
the  time  series.  In  this  procedure  it  is  assumed  that  [A^] 
and  are  given  in  advance  and  that  white  noise  W]^(I) 
and  W2(I)  have  been  previously  generated  and  are  available 
in  a  white  noise  data  file. 

The  difference  equation  is  implemented  by  a  program  with 
the  title  "GEN"  [Appendix  A].  If,  for  example,  the 
observation  vectors  x  and  ^  have  32  time  points  each  and  a 
set  of  128  independent  vectors  is  needed  then  the  program 
GEN  generates  two  data  sets.  Each  is  an  array  of  size  128  X 
32  whose  rows  represent  individual  vectors  x  and  y.  These 
data  are  written  to  the  disk  with  file  names  such  as  "Xll", 
"X12",  "Yll",  and  "Y12"  to  be  used  later  in  the  decision 
test  algorithm.  In  the  file  name  X12  the  first  number  "1" 
represents  test  case  one,  and  second  number  2  stands  for 
class  2  data. 

B.  GENERATION  OF  STATISTICS  OF  RANDOM  VECTORS 

After  the  observation  vectors  in  files  Xll,  Yll,  X12, 
and  Y12  are  generated,  the  joint  statistics  of  these  vectors 
are  calculated.  The  statistics  are  used  in  the  decision 
algorithms . 

Let  the  dimension  of  the  vectors  be  N  and  M  and  the 
number  of  vectors  generated  be  L.  Then  mean,  covariance, 
and  cross  covariance  parameters  are  calculated  using  the 
following  equations: 


class  2.  These  calculations  are  performed  by  the  program 

"STAT"  [Appendix  B]  and  the  parameters  are  written  to  output 

files.  From  the  file  of  vectors  Xll  the  program  STAT 

generates  and  ;  from  Yll  it  produces  m„^^) 

M  r 

and  ;  and  from  both  Xll  and  Yll  it  calculates 

.  These  represent  the  statistical  parameters  of  the 
class  1  data.  The  files  X12  and  Y12  are  used  in  a  similar 
manner  to  produce  and 

[B„.„'‘^''].  These  represent  the  statistical  parameters  of  the 
class  2  data. 

C.  CLASSIFICATION  PROGRAM 

When  observation  vectors  and  their  statistics  are 
available,  one  can  test  the  distributed  classification 
algorithms  and  compare  their  results  to  the  results  of  the 
centralized  algorithm.  A  program  "DECAL"  [Appendix  C]  was 
written  to  implement  these  decision  algorithms.  This 
program  has  three  main  parts  consisting  of  distributed 
decision  rule  A(denoted  simply  by  "A"),  distributed  decision 
rule  B(denoted  simply  by  "B"),  and  the  centralized  decision 
rule(denoted  simply  by  "C").  In  this  program  every 
algorithm  computes  its  own  log  likelihood  ratio  statistic  to 
be  compared  to  the  threshold  value.  The  statistics 
corresponding  to  each  pair  of  observation  vectors  for  each 
of  the  decision  rules,  A,  B,  and  C  are  written  to  a  disk 
file  and  used  to  compute  the  correct  decision  rates. 

A  Fortran  program  "ANAL"  [Appendix  D]  generates  the 
varying  threshold  values  that  are  used  with  the  data 
generated  by  DECAL  to  decide  upon  the  classes  of  the 
observed  objects.  This  organization  of  programs  allows  us 
to  generate  classification  results  for  many  threshold  values 
without  excessive  computation.  The  threshold  values  are 
expressed  in  terms  of  the  prior  probabilities  Pj-Ccoj^)  and 
Pj.(a52)  which  are  chosen  so  that  the  condition  of  "Pj.(cO]^)  * 
Pj.(co2)  "  1.0"  is  satisfied. 
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D.  CLASSIFICATION  EXPERIMENTS 

If  a  correct  analysis  is  performed,  one  can  fit  an 
appropriate  time  series  model  to  the  sensor  data  to 
represent  the  observations  made  on  two  distinct  types  of 
targets  such  as  those  shown  in  Fig.  4.1. 


.r. .. 


Figure  4.1  Aircraft  Type  Detection 
and  Observation  Vectors 


For  the  analysis  here  we  are  more  interested  in 
characterizing  the  distributed  decision  algorithm 
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performance  for  various  second  moment  statistical  properties 
of  the  observation  vectors,  such  as  mean,  variance,  and 
correlation.  The  cases  chosen  for  analysis  should  no  j  be 
interpreted  to  mean  that  we  are  attempting  to  model  real 
target  data. 

For  our  experiments,  we  generated  data  according  to  Eqs . 
4.1  through  4.3  with  the  order  of  the  difference 
equation(p)  equal  to  one.  Four  different  cases  were 
considered:  their  parameters  are  given  in  Table  3. 


Each  test  case  used  data  from  two  different  classes.  In  all 


but  case  1  the  filter  coefficients  [A]^]  and/or  the 
covariance  matrix  resulted  in  observation  vectors  x 
and  y  that  are  correlated  with  each  other.  If  the 
observation  vectors  x  and  y  are  uncorrelated,  the 
conditional  probability  density  function  p(ylx)  becomes  the 
same  as  the  unconditional  density  function  p(y).  If  this  is 


true  for  both  classes,  as  in  case  1,  then  the  three  decision 


rules  A,  B,  and  C  will  be  equivalent. 


Several  specific  cases  are  represented  here.  In  cases  1 
and  3,  the  class  2  filter  has  negative  A-^  parameters;  this 
makes  the  time  series  change  very  rapidly  up  and  dovm. 
Since  the  data  of  class  1  does  not  have  this  property,  we 
expect  that  the  decision  rules  can  discriminate  between  the 
two  classes  based  on  the  correlation  of  the  time  series.  In 
test  case  2,  class  2  has  non-zero  mean  while  class  1  has 
zero  mean.  Since  the  mean  values  are  the  only  differences, 
the  classification  can  only  be  based  on  these  differences  in 
the  mean  values.  In  test  case  4  the  mean  values  are  also 
non- zero  but  both  the  class  1  mean  and  the  class  2  mean  are 
the  same.  In  addition,  the  filter  parameters  for  each  class 
and  the  noise  covariances  are  very  similar.  This  makes  the 
classification  of  the  observations  a  relatively  difficult 
problem. 


TABLE  4 

CORRECT  DECISION  RATEC%) 
4-DIMENSIONAL  128  VECTORS 


TEST  CASE 

CLASS 

A 

B 

C 

CASE  #1 

CLASS-1 

85.9 

85.9 

85.2 

CLASS-2 

84.4 

85.2 

82.8 

CASE  #2 

CLASS-1 

93.0 

93.8 

92.2 

CLASS-2 

85.2 

85.9 

89 . 1 

CASE  #3 

CLASS- 1 

81.3 

83.6 

85.2 

CLASS-2 

85.9 

86.7 

85.9 

CASE  #4 

CLASS-1 

85.9 

87.5 

57.0 

CLASS-2 

19.5 

17.2 

60.2 

The  results  of  classification  for  these  test  cases  is 
shown  in  Tables  4  and  5.  The  results  are  based  on  a 
threshold  corresponding  to  equal  prior  probabilities.  The 
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first  test  set  was  4  -  dimensional  (i.e.  x  and  ^  each 
consisted  of  four  time  samples)  and  consisted  of  128  pairs 
of  observation  vectors  x  and  These  results  are  given  in 
Table  4.  Most  of  the  results  show  probabilities  of  correct 
classification  in  the  range  of  about  85  to  90  percent.  For 
test  case  4  the  probability  of  correct  classification 
achieved  by  decision  rules  A  and  B  is  quite  high  for  class  1 
but  very  low  for  class  2.  However,  if  the  classifier 
threshold  is  adjusted  by  choosing  different  prior 
probabilities,  the  results  are  similar  (but  slightly  worse) 
than  the  results  for  the  centralized  rule  C.  (The  reader 
may  refer  to  Appendix  E.) 


TABLE  5 

CORRECT  DECISION  RATE(%) 

3 2 -DIMENSIONAL  128  VECTORS 


TEST  CASE 

CLASS 

A 

B 

C 

CASE  #1 

CLASS- 1 

100. 

100. 

100. 

CLASS-2 

100. 

100. 

100. 

CASE  #2 

CLASS- 1 

100. 

100. 

100. 

CLASS -2 

100. 

100. 

100. 

CASE  #3 

CLASS -1 

100. 

100. 

100. 

CLASS -2 

99.2 

99.2 

93.8 

CASE  #4 

CLASS- 1 

100. 

100. 

88.3 

CLASS-2 

13.3 

6.3 

91.4 

The  second  test  set  was  32-dimensional  and  again 
consisted  of  128  observation  vectors  x  and  The  results 
are  given  in  Table  5.  Note  that  in  cases  1,  2,  and  3  all 
vectors  were  classified  correctly.  That  shows  that  the 
classes  are  easily  separated  by  any  of  the  decision  rules  if 
32  time  samples  are  used. 
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In  test  case  4,  the  degraded  performance  is  explained  by 
the  parameters  in  Table  3.  Here  both  classes  have  similar 
correlation  parameters,  and  both  mean  values  are  identical. 
This  case  was  designed  to  be  the  most  difficult. 

By  varying  the  prior  probabilities  one  can  change  the 
threshold  in  the  decision  algorithms  and  therefore  trade  off 
the  probability  of  correct  classification  of  one  class  for 
incorrect  classification  of  the  other  class.  A  graph  of 
these  probabilities  is  known  as  an  "operating 
characteristic"  for  the  decision  rule.  The  results  in 
Tables  4  and  5  represent  a  single  point  on  each  of  the 
operating  characteristics.  Operating  characteristics  for 
cases  1,2,3,  and  4  of  Table  4  and  case  4  of  Table  5  are 
given  in  Figs.  4.2  through  4.5.  The  three  different  types 
of  lines  in  the  graph  represent  the  results  of  the  three 
different  algorithms.  These  results  are  also  given  as 
tables  in  the  Appendices.  The  correct  decision  rate  is 
shown  in  the  output  data  "GRAPH4"  [Appendix  E]  for  the 
4-dimensional  cases  and  "GRAPH32"  [Appendix  F]  for  the 
32-dimensional  cases. 

It  is  interesting  to  note  that  in  most  cases  the 
performance  of  the  distributed  decision  rules  compared 
favorably  to  that  of  the  centralized  decision  rule.  It  is 
also  interesing  to  note  that  the  performance  of  decision 
rules  A  and  B  was  always  close  together  although  the  data  in 
the  test  cases  exhibited  no  symmetry  in  their  defining 
parameters . 


PR(W1  \V1) 


PR(wrwi) 


PR(tfi;wi) 


Pfifffl  Vil) 
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V.  CONCLUSIONS 


The  specific  goals  were  all  met  in  this  thesis.  The 
distributed  decision  rules  were  introduced  and  compared  to 
the  centralized  decision  rule.  Since  only  one  observation 
vector  (either  x  or  y)  is  available  in  each  processor,  the 
results  of  the  distributed  decision  rule  can  not  in  general 
be  the  same  as  those  of  a  centralized  decision  rule.  The 
decision  algorithms  were  explained  mathematically  and 
compared  to  one  another.  The  difference  between  the 
algoritlims  arises  from  the  fact  that  one  sensor  must 
estimate  the  observation  vector  of  the  other  sensor  using 
the  locally  measured  observation  vector  and  all  available 
parameters.  Simulation  experiments  for  a  number  of  cases 
with  different  statistical  properties  showed  that  when 
multiple  observations  are  involved,  the  two  distributed 
decision  rules  compare  favorably  to  the  centralized  decision 
rule.  Even  when  the  vectors  have  high  dimensionality,  only 
a  fixed  limited  amount  of  interprocessor  communication  is 
required . 

In  the  two  distributed  decision  rules,  if  each  processor 
has  a  different  class  decision  for  the  commonly  observed 
object,  an  ambiguous  situation  results.  In  this  case,  one 
can  either  disregard  that  decision  or  use  the  following 
method.  By  comparing  each  log  likelihood  ratio  statistic  to 
the  threshold  value,  one  can  select  the  decision  which  is 
further  from  the  threshold  value.  This  procedure  is 
intuitively  reasonable  because  decisions  made  when  the 
statistic  is  close  to  the  threshold  value (observations  in 
the  region  near  the  decision  boundary)  are  more  likely  to  be 
incorrect . 

Further  research  may  center  on  analytical 
characterization  of  these  distributed  decision  rules  and 
further  analysis  of  the  situation  where  the  two  rules  A  and 
B  do  not  agree. 


APPENDIX  A 
GEN  FORTRAN 


This  program  generates  two  sets  of  random  observation 
vectors  i.e.  Xll  and  Yll. 

INTEGER  H,I, J,K,L,M,N,P 

N=32 

M=32 

P=1 

READ(2,*)  MX, MY 

READ  2, '-O  ((  (a(I,J,K)  ,K=1,2),J=1,2)  ,I  =  1,P) 

readU,*)  aKwU,J),i=i,2),l=i,25 

READ(3,*,END=50)  (W1 (I ) , 1= 1 ,N) 

REAdU!*)  (W2(I)  ,1  =  1,N) 

XP ( 1 ) =KW( 1 , 1 )*W1 ( I ) >KW( 1 , 2 )*W2 ( 1 ) 

YP(1)=KWU,  1)*W1U)^KwU!2)*W2U) 

DO  30  1=2, N 

XPTi)=0. 

YPCI)=0. 

K=I 

IF  (I.GT.P)  K=P 
L=I-1 

DO  20  J=1,K 

XP(I)=XP(I)*A(J,1, 1)"XP(L)+A(J, 1,2)*YP(L) 
p(I^=YP(I)>A(J,2,l)’^XP(L)^A(J,2,2)nP(L) 
continue’ 

XP(I)=  XP(I)  +  KW(1,1}^--W1(I)  +  KW(l,2)*W2fI) 

YP(I)=  YPU)  ^  KwU,l)"Wia)  *  KW(2,2r"W2U 
CONTINUE 


DO  40  1=1, N 

X(I)=XP(I)>MX 
Y(lJ  =  YP(I)fMY 
CONTINUE 


GO  TO  10 

STOP 

END 


APPENDIX  B 
STAT  FORTRAN 


C  This  program  computes  all  the  necessary 
c  parameters  of  the  given  sets  of  vectors 

c  i.e.  Xll  and  Yll,  or  X12  and  Y12. 

c  Matrix  manipulation  subroutines  are 
c  from  the  IMSL  library  [Ref.  5]. 


c 

c 


c 

c 

c 

05 


^REALV.8  YP(32). 

•  KX(3i,3h,^ti;3L3i),pY(32,3 


10 

20 

c 


23 

c 

25 

c 

c 

c 


27 

c 


32), 
SBXY(32 ,32) 


XD(32.12g5 ,YDC 3^.l2S) , 

^  SKX(3l,32) ,SKY(3i,32) , 

INTEGER  I, J,K,L,M,N,IER 

L=128 

M=32 

N=32 

READ(2,*,END=05)  ( (XD(I , J ) , J= 1 , N ) , 1= 1 , L) 
READ(3  *)  (Tyd7i,JJ  ,J=1  M)  ,I=l,Lr 
WRITEfS ,*)  ( fXD(I, J) , J=1,N) ,I=1,L) 

WRITE(9  ,*)  ( (YD(I,  ,I  =  1,L) 

MX(I)=0. 

myU)=o. 

DO  20  1=1, N 
DO  10  ,)=1,L 

MX(I)=MX(I)>XD(J,I) 

MY(I)=MY(I)+YD(J,I) 

CONTINUE 

MX(I)=1. /L*MX(I) 

MY(I)  =  1./L"MyU) 

CONTINUE 

DO  23  I=1,N 
DO  23  Jf=l,N 
SKX(I, J)=0. 

SKYfl , J)=0. 

SBXY(I, J)=0. 

CONTINUE 

READ(4,*,END=35)  (X(I),I=1,N) 

READ(5,*J  (Y(l1,I=l,M) 

WRITEC6,*)  (X(l1,I=l,N) 

WRITE  (7,'")  (Y(I),I=1,M) 

DO  27 


1=1, N^ 

)=xfi 

i-MX(I) 

=  Y  I 

i-MX(l) 

CONTINUi 

CALL  VMULFP (X,X,N,1,N,N,N,KX,N,IER) 
CALL  VMULFP(Y,Y,M, l,M,M,M,KY,M.IERj 
CALL  VMULFP(X,Y,N, 1,M,N,M,BXY,N,IER) 
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APPENDIX  C 
DECAL  FORTRAN 

This  program  computes  the  final  scalar  values 
of  three  different  algorithms  which  will  be 
compared  with  the  threshold  value. 

Matrix  manipulation  subroutines  are  from 
the  IMSL  library  [Ref.  5]. 


DECI^^TIQNS.^'PR  DIST,  .  RUl^E  A 


REAL*  8 


RX , RPY , SUMl , SUM2 , SUM3 , SUM4 , SUMS 
PRW1,PRW2,T,VAL, 

DKXl ,DKX2 ,DKY1 .DKY2 ,DKYX1 ,DKYX2 
MIMl|MIM2;Cl,ci, 

X(32) ,MX1(32) ,MX2(32) , 

Yh2l  ,MYlh2l  .MY2(32K 

!l^). 


2(32) ,BIM1 
202);mIB1 


REAL*8 


Al(32,32) ,B1(32), 

A2n2,32)  ;B2b2)’ 


WKAREA(1160) , 

KXl (32, 32) ,1^X1(32,32) ,KX1D( 32,32 ) , 
KX2(32,32) ,IKX2(32  32)  KX2D(32  32) 
KY1(32,32) ,IKY1(32,32),KY1D(32  32) 
KY2(32.32j,IKY2n2  32)  KY2dU2  32) 
BXY1(3^,32  , 

BXY2(32,32i , 

KYX1(32,32) ,IKYX1(32,32) ,KYX1D(32,32 
KYX2(32,32)  ,IKYX2  02,32)  ,KYX2dU2  32 


REAL* 8 


BBIX 

BXIY 

BY1( 


BKB1(32,32) ,BKB2(32,32 
IBY1(32,32) ,IBY2(32  32' 
BYI1(32,32) ,BYI2(32,32' 
BIBin2,32)  ,BIB2b2  32' 


INTEGER  I,J,L,M,N 


n n n n n n  n  non  o  n  nnnnnn  no  n  non 


lA , IDGT , lER, CLASS , 

,  NCLAS 1 ,  NCLAS2 

^  ««  *\  *%  4%  •%  4\  4%  ««  4\  4\  4%  4%  4%  4%  4%  4\  4*  4\,  4%  4% 

REAL*8  BKXl{32,32)  ,BKX2f 32.32) , 


IKXYlf32,32),IKXY2f 32.32) , 
IBX1(32  J2)  ,iBX2(32,3^), 
BXI1(32,32) ,BXI2 (32,32 ) , 
BIXlf32.32),BIX2f32,32), 
A3(32,3^) ,A4(32,32); 

MIX1(32) ,MIX2(32' 

BIPl(32l ,BIP2(32 
B1MX(32) ,B2MX(32' 

MKY1(32) ,MKY2(32' 


B3(32} .B4(32) , 
MBX1732) ,MBX2(32 
MB1X(32) ,MB2X(32 
IXB1(32) ,IXB2(32 


REAL*8  DKXY1,DKXY2,MXM1.MXM2.  C3,C4, 
►  SUMll,SUM12,SUMl3,SUMi4,SUM15, 

^  RY,RPX,VA 


INTEGER  CLA 


•*_,_  ._DE_C^^JJON_.  FQR_.  CENTRALIZED  , 


REAL*8  A5(32.32) ,B5(32) . 
xmxi732) ,Amx2(32' 
MBT1(32) ,MBT2(32 
MBK1(32) ,MBK2(32 


BYT1(32) ,BYT2(32 
KBT1(32) ,KBT2(32 


): 


MT 1 , MT2 , RB Y , C  5 , SUM24 , SUM2  5 , V 


INTEGER  CL, COUNT 

INITIALIZATION! ! ! ! 

NCL1=0 
NCL2=0 
NCLA1=0 
NCLA2=0 
NCLAS1=0 
NCLAS2=0 

L=0 
M=32 
N=32 
IDGT=4 

PRW2= .5 
PRW1= .5 

t=dlogTprwi/prw2) 

WRITE(7,")  T=^,T 

cINPUT  PARAMETERS! ! ! ! ! 
c 


READ(2, " ) (MYl(I) ,I=1,M) 

WRITE (7, *3 rMYl(I) ,i=l,N) 

READ72, '••')(  (KXl?I,jj  ,  J=1,N)  ,I  =  1,N) 
WRIT6(7,"3((KXi(I,J),.)=l,N)  ,i=l,N) 
READt2,*)  (KY1(I, J)  J=i,M)  ,lU,M) 
WRITE(7 ,")?rKYi(I, J) ,J=1,M) 
READ(2,->0  (BXY1(I,J  ,i=l,M),f  =  l,N 


nonooono  no  r>  oo  o  oo  o  no  oo  oooo  ooooo  ooo 


DO  01  1=1, N 

DO  01  J=1,N, 

KX1D(I, J)=KX1(I,J) 

KX2Da,  J)=KX2(I,J) 

CONTINUE 

WRITE(7,*)((KX1D(I,J),J=1,N),I=1,N) 
WRITEb  *K(KX2DU  J)  ,J=1,N),I=1,N) 


DO  02  1=1. M 
DO  02  J=1,M, 

KY1D(I  J)=KY1(I,J) 

KY2dU  J)=KY2(I,J) 

CONTINUE 


SUBROUTINES 


»  I  t  I  »  t 


CALL  LINV2F  (KXl.N.N, IKXl, IDGT.WKAREA, lER) 
WRITE(7,*U  lixi(l,J)  J=1,N  .I=1,N 
WRITE  ( 7  ’  * )  C  (KXl  ( 1 ,  ,  ,>=  1 ,  4  =  1,1^) 

CALL  LINV2^'  (kX2  ,N  .N,  ife  ,  l£)GT,  WKaAeA,  lER) 
WRITE(7,*)((I]^X^(i,J),,)=l,N),I=l,N) 

CALL  LINV2F  (KY1,M,M,IKY1,IDGT,WKAREA,IER) 

A  lER) 

WRITE(7,*)((I^Y^(i,J) ,J=1,m5,I=1,m5 

CALL  DTERM  (N ,KX1D .DKXl ,N) 

WRITER, -0  'DKXl  =  ^,DKil^ 

CALL  DTERM  (N ,KX2D ,DKX2 ,N) 


CALL  DTERM  (M,KY1D,DKY1,M) 

WRITE (7,*) ’DKY1= '  DKYl 
CALL  DTERM  (M,KY2D,pKY2,M) 

WRITE(7,") 'DKY2=^,DKY2 

CALL  VMULFM  (BXYl , IKXl ,N ,M , N , N , N , BBlX ,M , lER) 
CALL  VMULFF  ^XYl , IKYl , N ,M,M, N ,M, BXIY , N , lER) 


WRITE 


CALL  VMULFM  (BXY2 , IKX2 , N ,M , N , N , N , BB2X ,M , lER) 
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n  n  n  n  n  n  o  n  o  n  o  n  n  n  n  n  ro  o  nnno  o  n  n  o  m  noon  noon  noon  n  o  n  o  n  o  n 


CALL  VMULFF  (BXY2 , IKY2 ,N ,M,M, N ,M, BX2Y , N , lER) 


'  7  ,  * )  ( 

IKX2(I,J] 

,J=1,N 

,I=1,N) 

'  5  "  )  ( 

IKY2(I,J 

J=1  M 

BXY2(I,J 

,J=1  M 

^  7  ,  *  1  ( 

BB2XfI,J 

,J=1,N 

,i=i,m1 

^  7  ,  *  H 

BX2Y(I,J 

,J=1,M 

.I=1,N) 

CALL  VMULFF  (BB1X,BXY1,M 
CALL  VMULFF  (BB2X,BXY2,M 

WRITE(7,*) ( (BKB1(I, J) 

WRITE ( 7 , * H ( BKB2 U , J ) 

CALL  VMULFF  (BB1X,BX1Y,M 
CALL  VMULFF  Ub2X,BX2Y,M 


n,m,m,n,bkbi,m,ier) 

N,M,M,N,BKB2,M,IER) 

J=1,M) ,I=1,M) 
J=1,M),I=1,M) 

N,M,M,N,BY1,M,IER) 

N,M,M,N,BY2,M,IER) 


WRITE(7,*) ( (BY1(I, J) , J=1,M) ,I=1,M) 
WRITE(7,*)  ((BY2U,>J)  ,  J=  1  ,M)  ,  1  =  1  ,M) 

CALL  VMULFF  (BYl ,MY1 ,M ,M, 1 ,M,M, BIMY ,M , lER) 
CALL  VMULFF  (BY2 ,MY2 ,M ,M, 1 ,M ,M , B2MY ,M , lER) 

WRITE (7,*) (BIMY(I) ,I=1,M) 


WRITE (7 


DO  10  1=1, M 

MB1(I)=MY1(I)-B1MY(I) 

MB2 (I ) =MY2 ( I ) -B2MY ( I ) 

CONTINUE 

WRITE (7,*) (MBl(I) ,I=1,M) 

WRITE (7,*)  (MB2UKi=1,M) 

CALL  VMULFF  (MXl , IKXl , 1 , N , N , 1 , N ,MK1 , 1 , lER) 
CALL  VMULFF  (MX2 , IKX2 , 1 , N , N , 1 , N ,MK2 , 1 , lER) 


WRITE! 

(MK1(1 

WRITE 

:7,*) 

(MK2(I 

DO  20  1=1, M 
DO  20  J=1,M 

K YX 1(I,J)=KY1(I,J)- BKB 1 ( I , j ) 

KYX2 ( I , J ) =KY2 ( I , J ) - BKB2 ( I , J ) 

KYXlDfl , J)=KYX1(I, J) 

KYX2D ( I , J ) =KYX2 U , J ) 

CONTINUE 

WRITE(7,"H  (KYX1(I,J)  ,  J=1,M)  ,I=1,M) 
WRITE(7  ,*)  (  (KYX2(I,  J;  ,  J=1,MKI=1,M; 

CALL  LINV2F  (KYXl ,M,M, IKYXl , IDGT , WKAREA, lER) 
CALL  LINV2F  (KYX2 ,M,M, IKYX2 , IDGT , WKAREA, lER) 

WRITE(7,*) ( (IKYXlfl, J) , J=1,M) ,I=1,M) 

WRITE(7  ,*)  (UkYX2(I,J)  ,  J=  1 ,  mK  I=  1 

CALL  DTERM  (M,KYX1D,DKYX1,M) 

CALL  DTERM  (M,KYX2D,DKYX2 ,M) 

WRITE(7,-")  'DKYX1=’  ,DKYX1 
WRITE ( 7 , * ) ’ DKYX2  = ' , DKYX2 

CALL  VMULFF  ( IKYXl , BYl ,M ,M ,M ,M,M , IBYl , M , lER) 
CALL  VMULFF  (IKYX2 ,BY2 ,M,M,M,M,M, IBY2 ,M, lER) 

WRITE (7,*) f (IBY1(I,J) , J=1,M) ,I=1,M) 
WRITE(7  ,")  (  (IBY2U,J;  ;i=l,M) 
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on  -J>  on  n  n  n  n  o  n  oj  noon  noon  nnnn  onno  noon  noon  nono 


CALL  VMULFF  (IKYXl , MBl ,M,M, 1 ,M,M, IMBl ,M, lER) 
CALL  VMULFF  ( IKYX2 ,MB2 ,M,M, 1 ’m ,M, IMB2 ,M , lER) 


WRITE ( 7 , * 
WRITE (7  ,* 

)(IMB1(I) 

)(IMB2U) 

,I=1,M) 

CALL  VMULFM 
CALL  VMULFM 

(BYl, IKYXl, M,M,M,M,M,BYI1,M,IER) 
UY2,IKYX2,M,M,M,M,M,BYI2,M,IER) 

WRITE (7  ,* 
WRITE ( 7  ,  * 

jiffiYlMl 

,J) ,J=1,M) 

,j),j=i:m) 

,I=1,M) 

,I=1,M) 

CALL  VMULFF 
CALL  VMULFF 

(BYI1,BY1 

(BYI2,BY2 

,M,M,M,M,M 

,M,M,M,M,M 

,BIB1,M,IER) 

,BIB2,M,IER) 

WRITE (7,* 
WRITE ( 7 , * 

jiffilllil 

,J),J=1,M) 

,J),J=i:Mi 

,I=1,M) 

CALL  VMULFF 
CALL  VMULFF 

(BYI1,MB1 

(BYI2,MB2 

,M,M,1,M,M 

,m,m:i:m;m 

,BIM1,M,IER) 

,BIM2,M,IER) 

WRITE(7 ,* 
WRITE  (7,"' 

,I=1,M) 
.1=1, M) 

CALL  VMULFM  (MBl , IKYXl ,M, 1 ,M ,M,M ,MBI1 , 1 , lER) 
CALL  VMULFM  (MB2 , IKYX2 ,M, 1 ,M,M,M,MBI2 , 1 , lER) 


WRITE 

(MBI1(1 

WRITE 

(MBI2(n 

.),i=i:m) 

CALL  VMULFF  (MBIl ,BY1 , 1 ,M,M, 1 ,MIB1 , 1 , lER) 
CALL  VMULFF  (MBI2 ,BY2 , 1 ,M,M, 1 1m!mIB2 , 1 , lER) 


WRITE 

7.?) 

(MIB1(3 

■)  ,I  =  1,M) 

write! 

7,*) 

(MIB2(3 

.),I  =  1,H) 

CALL  VMULFF  (MBl 1 ,MB 1 , 1 ,M, 1 , 1 ,M ,MIM1 , 1 , lER) 
CALL  VMULFF  (MBI2  ,MB2 , 1  ,  1 , M,MIM2 , 1  ’  IER) 

WRITE(7,*) 'MIM1= ' ,MIM1 
WRITE(7 ,*) 'MIM2= ' ,MIM2 

DO  30  I=1,N 

B1(1)=2.*(MK1(I)-MK2(I)) 

DO  30  J=1,N 


(J) 


CONTINUE 


Al(I,jJ=IKX2ri, J)-IKX1(I,J) 
SUM3 = SUM3 +MX2 Til " IKX2 ( I , 3 ) "MX2 
-MXl(I)*IKXl(I,J)%il(j) 

UE 

WRITE (7,*) ( (A1(I,J) ,J=1,N) ,I=1,N) 
WRITE(7;*)(Bl(lKl  =  i,N) 


C 1 =  SUM3  +  DLOG ( DKX2 / DKX 1 ) 

WRITE(7,*) 'C1=^,C1 

DO  40  1=1, M 

B2  ( i  )  =Bi:i2  (■  I )  +MIB2  ( I )  -  IMB2  if  I }  -MBI2  ( I ) 

-?BIMl(l)+MIBl(l)-IMBl(l)-MBIl(I) 
DO  40  J=1,M 

A2 ( I , J ) = IKYX2 ( I , J ) - IBY2 ( I , J ) 
-BYI2(i,J)TBIB2(l,3) 

-7iKYX1(I, J)-IBYltl, J) 

-BYI1(I  J)+6IB1(I  J  ) 

CONTINUE 

C2  =  MIM2 - MIM 1  +  DLOG ( DKYX2 / DKYX 1 ) 
WRITE(7,*)((A2(I,J),J=1,N),I=1,N) 
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WRITEf7,*J (B2(;) ,I=1,N) 
WRITE(7,*)^C2=^,C2 

READ(4,t,?ND=299)(X(p,I=l,N) 

read(5,*)Ty(i) 

^'^WRITE(7,*J  fXfI},I=l,N) 
WRITER, *)  UuhI  =  l.M) 

SUM1=0. 

SUM2=0. 

SUM3=0. 

SUM4=0. 

SUM5=0. 

SUM11=0. 

SUM12=0. 

SUM13=0. 

SUM14=0. 

SUM15=0. 

SUM24=0. 

SUM25=0. 

SUM^=SUM2+B1(I)*X(I) 

DO  50  J=1,N  .  ,  .... 

S UM 1 = s6m  1  +  X  ( I )  ''A  1  ( I ,  J  )  "X  ( J  ) 

RX=0^5*(SUM1+SUM2+C1) 

SUM5=SUM5+B2(I)*Y(I) 

SUM4=  s6m4+ Y ( I ) *A2 ( I , J ) *Y ( J ) 
CONTINUE,  ,  c 
RPY=0 . 5*(SUM4+SUM5+C2 ) 

VAL=RX+RPY 

IF(VAL.GT.T)  THEN 
CLASS=1 

NCLAS1=NCLAS1+1 

ELSE 

CLASS =2 

NCLAS2=NCLAS2+1 
END  IF 


c*************^^^^^^  DISTRIBUTED  RULE  B  .  v"'*' 

WV 

cSUBROUTINES! ! ! ! ! ! 
c 


CALL  VMULFP  (BXIY , BXYl ,N ,M, N , N , N , BKXl , N , lER) 
CALL  VMULFP  Ux2Y , BXY2 ,N ,M,N , N ,N , BKX2 , N , lER) 

CALL  VMULFF  (BXlY , BBIX , N ,M, N , N ,M , BXl , N , lER) 
CALL  VMULFF  Ux2Y , BB2X , N ,M, N , N ,M , BX2 , N , lER) 


•>  f%  r%  ^  t\  »%  •*  •%  *\  •s 


CALL  VMULFF 
CALL  VMULFF 


(BX1,MX1,N,N, 1,N,N,B1MX,N,IER) 
UX2,MX2,N,N,1,N,N,B2MX,N,IER) 


V  1 
•  •'* 


r  •* 


l.  - 


L  .  J 


L  ,  .i 


>  i 


»  4 


»  4 


60 


110 

c 

c 


c 

c 


c 


120 

c 

c 


c 

c 


c 

c 


c 

c 


c 

c 


c 

c 


c 

c 


c 

c 


c 

c 


c 

c 


c 

c 


130 


DO  110  1=1, N 

MBlxtl)=MXl(I)-BlMX(I) 

MB2XXI)=MX2(I)-B2MX(I) 

CONTINUE 

CALL 

CALL 

VMULFF 

VMULFF 

(MY1,IKY1,1,M,M, 1,M,MKY1, 1,IER) 
(MY2,IKY2, 1,M,M,1,M,MKY2,1,IER) 

DO  120  1=1, N 
DO  120 
KXY1(I 

KXY2U 

1'J^=KX1(I,J)-BKX1(I,J) 

, J)=KX2(I, J)-BKX2(I, J) 

KXY1D( 

KXY2D( 

CONTINUE 

I, J)=KXY1(I, J) 

I,J)=KXY2(I,J) 

CALL 

CALL 

LINV2F 

LINV2F 

(KXY 1 , N , N , IKXYl , IDGT , WKAREA , lER ) 

( KXY2 , N , N , IKXY2 , IDGT , WKAREA , lER ) 

CALL 

CALL 

DTERM  ( 
DTERM  ( 

N,KXY1D,DKXY1,N) 

N,KXY2D,DKXY2,N) 

CALL 

CALL 

VMULFF 

VMULFF 

( IKXYl, BX1,N,N,N,N,N,IBX1,N,IER) 
(IKXY2,BX2,N,N,N>,N,IBX2,nUeR) 

CALL 

CALL 

VMULFF 

VMULFF 

(IKXY1,MB1X,N,N,1,N,N,IXB1,N,IER 

(IKXY2,MB2X,N,N,1,N,N,IXB2,N,IER 

CALL 

CALL 

VMULFM 

VMULFM 

(BXl, IKXYl, N,N,N,N,N,BXI1,N,IER) 
(BX2,IKXY2,N,N|N,n;n,BXI2,nUer) 

CALL 

CALL 

VMULFF 

VMULFF 

(BXI1,BX1,N,N,N,N,N,BIX1,N,IER) 

(BXI2,BX2,N,N,N,N,N,BIX2,N,IER) 

CALL 

CALL 

VMULFF 

VMULFF 

(BXI1,MB1X,N,N, 1,N,N,BIP1,N,IER) 
(BXI2,MB2X,N,N,1,N,N,BIP2,N,IER) 

CALL 

CALL 

VMULFM 

VMULFM 

fMBlX,IKXYl,N,l,N,N,N,MBXl,l,IER 

(MB2X,IKXY2,N,1,N,N,N,MBX2U,IER 

CALL 

CALL 

VMULFF 

VMULFF 

(MBX1,BX1,1,N,N,1,N,MIX1,1,IER) 

(MBX2,BX2,1,N,N,1,N,MIX2,1,IER) 

CALL 

CALL 

VMULFF 

VMULFF 

(MBX1,MB1X,1,N,1,1,N,MXM1,1,IER) 

(MBX2,MB2X,l,N,l,l,N,MXM2;i,IER) 

DO  130  1=1, M 

B4fll=2.*(MKYl(I)-MKY2(I) ) 

DO  130  i=l,M 

A4Ti.J)=IKY2CI, J)-IKYlfI, J) 

SUMl5  =  SUMl3+MY^(I)*IKYHi  ,  J)*MY2(J) 

+  -MYl(I)*IKYl(l,J)*HYi(i) 

CONTINUE  • 

C4=SUM13+DL0G(DKY2/DKY1) 

DO  140  1=1, N 

^  - (BIPl(l)+MIXl(l)-IXBl(l)-MBXl(: 

DO  140  J=1,N 

A3(I, J)=IKXY2(I, J)-IBX2(I, J) 

^  '-BXI2Xi,^)tBIX2.(l,^):. 


i,J)+BIX2(I,J) 

1(1, jT-ibxi(i, j; 
i,j)>bixi(i,j3) 


CONTINUE 

C  3  =  MXM2  -  MXM 1  DLOG  (  DKX  Y2  /  DKX  Y 1 ) 


DO  150  1=1. N 

SUM1^=SUM12+B3(I)*X(I) 

DO  150  J=1,N 

SUM11=SDM11+X(I)*A3(I, J)*X(J) 
CONTINUE 

RPX=0.5"(SUM11+SUM12+C3) 

DO  160  1=1, M 

SUM15  =  SUM15  +  B4(I)"'Y(I) 

DO  160  J=1,M 

SUM14=SUM14+Y(I)*A4(I, J)*Y(J) 
CONTINUE 

RY=0.5---(SUM14+SUM15  +  C4) 


VA=RPX+RY 


IF(VA.GT.T)  THEN 
CLA=1 

NCLA1=NCLA1+1 

ELSE 

CLA=2 

NCLA2=NCLA2+1 
END  IF 


_9JENT^LIZED_.DECISION_,_RyLE 


XMXl 

XMX2 

CONTINU 


1=1, N 

(I  =X(I 

)-MXl(I) 

)-MX2U) 

CALL  VMULFF  (BBIX , XMXl ,M,N , 1 ,M , N , BYTl , M ,  lER) 
CALL  VMULFF  (BB2X , XMX2 ,M, N , 1 ,M , N , BYT2 ,M , lER) 


MBTl 

MBT2 

CONTINU 


(I)=MY1(] 

;)+BYTl(I) 

II)=MY2(] 

:)+BYT2(I) 

CALL  VMULFF  ( IKYXl ,MBT1 ,M ,M , 1 ,M,M,KBT1 ,M , lER 
CALL  VMULFF  (IKYX2 ,MBT2 ,M,M, 1 ,M,M,KBT2 ,M, lER 


CALL  VMULFM  (MBTl , IKYXl ,M, 1 ,M,M,M,MBK1 , 1 , lER 
CALL  VMULFM  (MBT2 , IKYX2 ,M, 1 ,M,M,M,MBK2 , 1 . lER 

CALL  VMULFF  (MBKl ,MBT1 , 1 ,M, 1 , 1 ,M,MT1 , 1 , lER) 
CALL  VMULFF  (MBK2 ,MBT2 , 1 ,M, 1 , 1 ,M,MT2 , 1 , lER) 


240 


c 

c 


260 


c 

c 


c 

c 


L98 

c 

i299 

c 

c 

c 

c 

c 

c 


DO  240  1=1, M 

B5j:i5=KBTl(I)+MBKl(I)-(KBT2(I)+MBK2(I)) 
DO  240  J=1,M 

A5(I,J)=IKYX2(I,J)-IKYX1(I, J) 

CONTINUE 

C5=MT2-MT1+DL0G( DKYX2 / DKYX 1 ) 

DO  260  1=1, M 

SUM25=SUM25+B5(I)*Y(I) 

DO  260  J=1,M 

SUM24= SDM24+ Y ( I ) *A5 ( I , J ) *Y ( J ) 

CONTINUE 

RBY=0.5~(SUM24+SUM25+C5) 


V=RX+RBY 


IF(V.GT.T)  THEN 
CL=i 

NCL1=NCL1+1 

ELSE 

CL=2 

NCL2=NCL2+1 
END  IF 

WRITE(7,*)  VAL,VA,V 

WRITE (7, 298)  V,  T,  CLASS,  CLA,  CL 
FORMAT  (2X,E15!8,ix,F5.3,2X,3i7) 

GO  TO  45 


RATEA1=100. 

RATEA2=100. 

RATEB1=100. 

RATEB2=100. 

RATEC1=100. 

RATEC2=100, 


*NCLAS1/L 

*NCLAS27L 

7NCLAI/L 

*NCLA2/L 

*NCL1/L 

’•NCL2/L 


c  WRITE (7,*)  L,NCLAS1,NCLA1,NCL1 

c  WRITE (7,*)  RATEAl.RATEBl.^TECl 

c  WRITE (7,*)  L,NCLAS2 ,NCLA2,NCL2 

c  WRITE (7,*)  RATEA2,RATEB2,RATEC2 

299  STOP 

END 


APPENDIX  D 
ANAL  FORTRAN 


This  program  counts  the  number  of  correct  decisions 
of  three  algorithms  and  calculates  the  correct 
decision  rates  of  them 


REAL*8  T,PRW1,PRW2, 

RATEAl .RATEA2 .RATEBl .RATEB2 ,RATEC1 ,RATEC2 , 
VAL(12S),VA(ll8),V(1^8) 


INTEGER  I,J,L, 

CLASS, CLA, CL, 
NCLASi ,NCLA1 ,NCL1 , 
NCLAS2,NCLA2,NCL2 


L=128 


DO  10  1=1, L 

READ  U,*)  VAL(I)  ,VA(I),V(I) 
CONTINUE 


PRW1=0.005 
PRW2=1. -PRWl 

T=DL0G(PRW2/PRW1) 

NCLAS1=0 

NCLAS2=0 

NCLA1=0 

NCLA2=0 

NCL1=0 

NCL2  =  0 


DO  30  I=1,L 

IF  TvALTi) .GT.T)  THEN 

NCLASi=NCLASl+l 

ELSE 

CLASS=2 

NCLAS2=NCLAS2+1 
END  IF 


NCLA1=NCLA1+1 

ELSE 


CLA=2 

NCLA2=NCLA2+1 
END  IF 


IF  (V(I).GT.T)  THEN 


mn  o  no  nnonoo  nnooooo  o  o  on  cjo  o 


NCL1=NCL1+1 

ELSE 

CL=2 

NCL2=NCL2+1 
END  IF 

0  CONTINUE 

RATEA1= 100 . *NCLAS 1 / L 
RATEA2  =  100 . *NCLAS2 / L 

RATEB1= 100 . *NCLA1/L 
RATEB2= 100 . *NCLA2/L 

RATEC1=100.*NCL1/L 
RATEC2= 100 . *NCL2/L 

WRITE  (7,*)  CLASS, CLA, CL 

WRITE  (7,*)  PRW1,PRW2,T,L 

WRITE  (7,*)  NCLAS1,NCLA1,NCL1 

WRITE  (7,*)  RATEA1,RATEB1,RATEC1 

WRITE  (7,*)  NCLAS2,NCLA2,NCL2 

WRITE  (7,*)  RATEA2,RATEB2,RATEC2 

PRWl  =  PRWl^-0.005 

IF  (PRWl.GE.1.0)  GO  TO  299 
GO  TO  20 

299  STOP 


APPENDIX  E 
GRAPH4  DATA 


These  data  files  show  the  correct  decision  rates 
of  4  dimensional  observation  vectors.  The  first 
data  is  ANALll  which  represents  case  1  and  class  1 
results.  The  capital  letters  "A”  and  "B"  represent 
distributed  decision  rules  A  and  B,  and  "C"  means 
the  centralized  decision  rule. 

The  varying  prior  probability  Pr(wl)  is  given  in 
the  first  column. 
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A  N 

A 

L  1  1 

NO.  of 

correct 

correct 

decision 

decisions 

rates (%) 

Pr (wl) 

A 

B 

C 

A 

B 

C 

0.050 

52 

52 

52 

40.625 

40.625 

40.625 

0.100 

62 

64 

63 

48.438 

50.000 

49.219 

0.150 

70 

70 

72 

54.688 

54.688 

56.250 

0.200 

77 

75 

79 

60.156 

58.594 

61.719 

0.250 

81 

82 

83 

63.281 

64.063 

64.844 

0.300 

88 

91 

89 

68.750 

71.094 

69.531 

0.350 

95 

95 

95 

74.219 

74.219 

74.219 

0.400 

99 

98 

100 

77.344 

76.563 

78.125 

0.450 

105 

105 

104 

82.031 

82.031 

81.250 

0.500 

110 

110 

109 

85.938 

85.938 

85.156 

0.550 

110 

110 

112 

85.938 

85.938 

87.500 

0.600 

113 

114 

114 

88.281 

89.063 

89.063 

0.650 

115 

115 

116 

89.844 

89.844 

90.625 

0.700 

119 

119 

119 

92.969 

92.969 

92.969 

0.750 

120 

120 

120 

93.750 

93 . 750 

93.750 

0.800 

122 

121 

121 

95.313 

94.531 

94.531 

0.850 

123 

123 

123 

96.094 

96.094 

96.094 

0.900 

124 

125 

124 

96.875 

97.656 

96.875 

0.950 

125 

125 

126 

97.656 

97.656 

98.438 

A  N 

A 

L  1  2 

• 

NO.  of 

correct 

correct 

decision 

decisions 

rates (%) 

Pr(wl) 

A 

B 

C 

A 

B 

C 

0.050 

127 

127 

127 

99.219 

99.219 

99.219 

0.100 

126 

126 

125 

98.438 

98.438 

97.656 

0.150 

125 

125 

124 

97.656 

97.656 

96.875 

0.200 

124 

124 

124 

96.875 

96.875 

96.875 

0.250 

121 

122 

123 

94.531 

95.313 

96.094 

0.300 

117 

117 

120 

91.406 

91.406 

93.750 

0.350 

116 

116 

116 

90.625 

90.625 

90.625 

0.400 

116 

115 

115 

90.625 

89.844 

89.844 

0.450 

113 

112 

111 

88.281 

87.500 

86.719 

0.500 

108 

109 

106 

84.375 

85.156 

82.813 

0.550 

105 

105 

103 

82.031 

82.031 

80.469 

0.600 

100 

100 

100 

78.125 

78 . 125 

78.125 

0.650 

96 

96 

99 

75.000 

75.000 

77.344 

0.700 

91 

91 

93 

71.094 

71.094 

72.656 

0.750 

87 

83 

85 

67.969 

64.844 

66 . 406 

0.800 

77 

77 

78 

60.156 

60.156 

60.938 

0.850 

70 

72 

70 

54.688 

56.250 

54.688 

0.900 

65 

63 

66 

50.781 

49.219 

51.563 

0.950 

57 

57 

61 

44.531 

44.531 

47.656 

A  N  A  L  2  1 


NO.  of  correct 

correct  decision 

decisions  rates(%) 


Pr (wl) 

A 

B 

C 

A 

B 

C 

0. 

050 

86 

88 

82 

67. 

.188 

68 

.750 

64, 

.063 

0. 

100 

104 

100 

91 

81, 

.250 

78 

.  125 

71. 

.094 

0. 

150 

108 

104 

102 

84, 

.375 

81 

.250 

79, 

.688 

0. 

200 

109 

109 

107 

85. 

.156 

85 

.  156 

83, 

.594 

0. 

250 

110 

112 

111 

85. 

.938 

87 

.500 

86, 

,719 

0. 

300 

110 

114 

111 

85, 

.938 

89 

.063 

86. 

,719 

0. 

350 

113 

114 

113 

88. 

.281 

89 

.063 

88. 

.281 

0. 

400 

115 

120 

116 

89, 

.844 

93 

.750 

90, 

,625 

0. 

450 

117 

120 

118 

91, 

.406 

93 

.750 

92, 

.  188 

0. 

500 

119 

120 

118 

92. 

.969 

93 

.750 

92, 

,  188 

0. 

550 

119 

120 

119 

92. 

,969 

93 

.750 

92. 

,969 

0. 

600 

121 

122 

121 

94, 

.531 

95 

.313 

94, 

.531 

0. 

650 

123 

123 

123 

96, 

.094 

96 

.094 

96, 

.094 

0. 

700 

124 

123 

123 

96. 

,875 

96 

.094 

96, 

.094 

0. 

750 

124 

123 

124 

96. 

.875 

96 

.094 

96, 

.875 

0. 

800 

125 

124 

125 

97, 

.656 

96 

.875 

97. 

,656 

0. 

850 

125 

124 

127 

97. 

,656 

96 

.875 

99. 

,219 

0. 

900 

126 

127 

127 

98, 

.438 

99 

.219 

99, 

.219 

0. 

950 

127 

127 

128 

99. 

.219 

99 

.219 

100. 

,000 

A  N  A  L  2  2 


NO.  of  correct 

correct  decision 

decisions  rates (%) 


Pr(wl) 

A 

B 

C 

A 

B 

C 

0. 

,050 

126 

126 

128 

98. 

,438 

98. 

438 

100, 

,000 

0. 

,  100 

123 

122 

126 

96. 

,094 

95. 

313 

98, 

,438 

0. 

,  1'  0 

122 

121 

123 

95. 

,313 

94. 

531 

96, 

,094 

0. 

,200 

119 

119 

120 

92. 

,  969 

92. 

969 

93, 

,  750 

0. 

,250 

118 

117 

118 

92. 

,  188 

91. 

406 

92. 

,  188 

0. 

,  300 

116 

117 

117 

90. 

,625 

91. 

406 

91, 

,406 

0. 

,350 

115 

115 

117 

89. 

,844 

89. 

844 

91, 

.406 

0. 

.400 

114 

113 

115 

89. 

,063 

88. 

281 

89, 

.844 

0, 

,450 

112 

113 

114 

87. 

,500 

88. 

281 

89, 

,063 

0, 

,500 

109 

110 

114 

85. 

,  156 

85. 

938 

89, 

,063 

0. 

,550 

109 

109 

110 

85. 

.156 

85. 

156 

85, 

.938 

0, 

,600 

107 

108 

107 

83. 

,594 

84. 

375 

83, 

.594 

0. 

,  650 

107 

108 

104 

83, 

,594 

84. 

375 

81, 

,250 

0. 

,700 

102 

103 

104 

79, 

,688 

80. 

469 

81, 

,250 

0, 

,750 

102 

103 

101 

79. 

,688 

80. 

469 

78, 

.906 

0, 

,800 

101 

98 

96 

78. 

,906 

76. 

563 

75, 

.000 

0, 

,850 

97 

93 

91 

75, 

,781 

72. 

656 

71, 

.094 

0, 

,900 

88 

91 

83 

68, 

.750 

71. 

094 

64, 

.844 

0, 

,950 

79 

80 

70 

61, 

,719 

62. 

500 

54, 

.688 

68 


A  N 

A 

L  3  1 

NO.  of 

correct 

correct 

decision 

decisions 

rates (%) 

Pr(wl) 

A 

B 

C 

A 

B 

C 

0.050 

58 

54 

59 

45.313 

42.188 

46.094 

0.100 

69 

67 

68 

53.906 

52.344 

53.125 

0.150 

74 

74 

76 

57.813 

57.813 

59.375 

0.200 

77 

76 

77 

60. 156 

59.375 

60.156 

0.250 

83 

83 

85 

64.844 

64 . 844 

66.406 

0.300 

84 

86 

89 

65.625 

67.188 

69.531 

0.350 

86 

87 

95 

67.188 

67.969 

74.219 

0.400 

93 

94 

100 

72.656 

73.438 

78.125 

0.450 

99 

102 

106 

77.344 

79.688 

82.813 

0.500 

104 

107 

109 

81.250 

83.594 

85.156 

0.550 

109 

109 

112 

85.156 

85.156 

87.500 

0.600 

112 

113 

115 

87.500 

88.281 

89.844 

0.650 

114 

114 

116 

89.063 

89.063 

90.625 

0.700 

117 

116 

117 

91.406 

90.625 

91.406 

0.750 

118 

117 

120 

92.188 

91.406 

93.750 

0.800 

120 

120 

120 

93.750 

93.750 

93.750 

0.850 

122 

121 

122 

95.313 

94.531 

95.313 

0.900 

124 

124 

124 

96.875 

96.875 

96.875 

0.950 

126 

126 

126 

98.438 

98.438 

98.438 

A  N 

A 

L  3  2 

NO.  of 

correct 

correct 

decision 

decisions 

rates (%) 

Pr(wl) 

A 

B 

C 

A 

B 

C 

0.050 

126 

126 

127 

98.438 

98.438 

99.219 

0.100 

125 

125 

125 

97.656 

97.656 

97.656 

0.150 

124 

124 

124 

96.875 

96.875 

96.875 

0.200 

122 

122 

124 

95.313 

95.313 

96.875 

0.250 

120 

120 

120 

93.750 

93.750 

93.750 

0.300 

117 

117 

117 

91.406 

91.406 

91.406 

0.350 

116 

116 

116 

90.625 

90.625 

90.625 

0.400 

115 

115 

114 

89.844 

89.844 

89.063 

0.450 

115 

114 

114 

89.844 

89.063 

89.063 

0.500 

110 

111 

110 

85.938 

86.719 

85.938 

0.550 

103 

103 

103 

80.469 

80.469 

80.469 

0.600 

99 

101 

101 

77.344 

78.906 

78.906 

0.650 

97 

96 

98 

75.781 

75.000 

76.563 

0.700 

90 

90 

93 

70.313 

70.313 

72.656 

0.750 

88 

89 

88 

68.750 

69.531 

68.750 

0.800 

84 

86 

82 

65.625 

67.188 

64.063 

0.850 

79 

80 

75 

-6^r7^9 

62.500 

58.594 

0.900 

71 

68 

66 

55.469 

53.125 

51.563 

0.950 

57 

56 

58 

44.531 

43.750 

45.313 

A  N  A  L  4  1 


NO.  of  correct 

correct  decision 

decisions  rates (%) 


Pr(wl) 

A 

B 

C 

A 

B 

c 

0.050 

3 

4 

1 

2.344 

3.125 

0.781 

0.100 

9 

8 

2 

7.031 

6.250 

1.563 

0.150 

16 

14 

3 

12.500 

10.938 

2.344 

0.200 

21 

23 

9 

16.406 

17.969 

7.031 

0.250 

30 

34 

14 

23.438 

26.563 

10.938 

0.300 

43 

44 

22 

33.594 

34.375 

17.188 

0.350 

55 

55 

34 

42.969 

42.969 

26.563 

0.400 

70 

71 

48 

54.688 

55.469 

37.500 

0.450 

89 

90 

61 

69.531 

70.313 

47.656 

0.500 

110 

112 

73 

85.938 

87.500 

57.031 

0.550 

123 

123 

86 

96.094 

96.094 

67.188 

0.600 

127 

127 

109 

99.219 

99.219 

85.156 

0.650 

128 

128 

118 

100.000 

100.000 

92.188 

0.700 

128 

128 

125 

100.000 

100.000 

97.656 

0.750 

128 

128 

126 

100.000 

100.000 

98.438 

0.800 

128 

128 

128 

100.000 

100.000 

100.000 

0.850 

128 

128 

128 

100.000 

100.000 

100.000 

0.900 

128 

128 

128 

100.000 

100.000 

100.000 

0.950 

128 

128 

128 

100.000 

100.000 

100.000 

A  N  A  L  4  2 


NO.  of 

correct 

•*- 

correct 

decision 

1 

decisions 

rates (%) 

Pr(wl) 

A 

B 

C 

A 

B 

C 

. '■*-****- 

0.050 

128 

128 

128 

100.000 

100.000 

100.000 

0.100 

127 

125 

128 

99.219 

97.656 

100.000 

0.150 

125 

125 

128 

97.656 

97.656 

100.000 

0.200 

122 

122 

128 

95.313 

95.313 

100.000 

1 

0.250 

114 

116 

127 

89.063 

90.625 

99.219 

i*  , 

0.300 

109 

106 

125 

85.156 

82.813 

97.656 

0.350 

96 

95 

122 

75.000 

74.219 

95.313 

0.400 

79 

78 

114 

61.719 

60.938 

89.063 

0.450 

49 

47 

98 

38.281 

36.719 

76 . 563 

0.500 

25 

22 

77 

19.531 

17.188 

60.156 

0.550 

10 

11 

62 

7.813 

8.594 

48.438 

0.600 

3 

3 

39 

2.344 

2.344 

30.469 

1 

0.650 

1 

0 

23 

0.781 

0.000 

17.969 

0.700 

0 

0 

13 

0.000 

0.000 

10.156 

0.750 

0 

0 

10 

0.000 

0.000 

7.813 

0.800 

0 

0 

4 

0.000 

0.000 

3.125 

*  *.  ■ 

0.850 

0 

0 

3 

0.000 

0.000 

2.344 

0.900 

0 

0 

1 

0.000 

0.000 

0.781 

- 

0.950 

0 

0 

1 

0.000 

0.000 

0.781 

APPENDIX  F 
GRAPHS 2  DATA 

These  data  files  show  the  correct  decision  rates 
for  32  dimensional  observation  vectors.  The  first 
data  is  ANALll  which  represents  case  1  and  class  1 
results.  The  capital  letters  "A"  and  "B"  represent 
distributed  decision  rules  A  and  B,  and  "C"  means 
the  centralized  decision  rule. 

The  varying  prior  probability  Pr(wl)  is  given  in 
the  first  column. 


I,.. 


A  N  A  L  1  1 


NO.  of 
correct 
decisions 


correct 
decision 
rates (%) 


Pr(wl) 

A 

B 

C 

A 

B 

c 

0.050 

128 

128 

128 

100.000 

100.000 

100.000 

0.100 

128 

128 

128 

100.000 

100.000 

100.000 

0.150 

128 

128 

128 

100.000 

100.000 

100.000 

0.200 

128 

128 

128 

100.000 

100.000 

100.000 

0.250 

128 

128 

128 

100.000 

100.000 

100.000 

0.300 

128 

128 

128 

100.000 

100.000 

100.000 

0.350 

128 

128 

128 

100.000 

100.000 

100.000 

0.400 

128 

128 

128 

100.000 

100.000 

100.000 

0.450 

128 

128 

128 

100.000 

100.000 

100.000 

0.500 

128 

128 

128 

100.000 

100.000 

100.000 

0.550 

128 

128 

128 

100.000 

100.000 

100.000 

0.600 

128 

128 

128 

100.000 

100.000 

100.000 

0.650 

128 

128 

128 

100.000 

100.000 

100.000 

0.700 

128 

128 

128 

100.000 

100.000 

100.000 

0.750 

128 

128 

128 

100.000 

100.000 

100.000 

0.800 

128 

128 

128 

100.000 

100.000 

100.000 

0.850 

128 

128 

128 

100.000 

100.000 

100.000 

0.900 

128 

128 

128 

100.000 

100.000 

100.000 

0.950 

128 

128 

128 

100.000 

100.000 

100.000 

A  N  A  L  1  2 


NO.  of 
correct 
decisions 


correct 
decision 
rates (%) 


Pr(wl) 

A 

B 

C 

A 

B 

c 

0.050 

128 

128 

128 

100.000 

100.000 

100.000 

0.100 

128 

128 

128 

100.000 

100.000 

100.000 

0.150 

128 

128 

128 

100.000 

100.000 

100.000 

0.200 

128 

128 

128 

100.000 

100.000 

100.000 

0.250 

1'  3 

128 

128 

100.000 

100.000 

100.000 

0.300 

1..8 

128 

128 

100.000 

100.000 

100.000 

0.350 

128 

128 

128 

100.000 

100.000 

100.000 

0.400 

128 

128 

128 

100.000 

100.000 

100.000 

0.450 

128 

128 

128 

100.000 

100.000 

100.000 

0.500 

128 

128 

128 

100.000 

100.000 

100.000 

0.550 

128 

128 

128 

100.000 

100.000 

100.000 

0.600 

128 

128 

128 

100.000 

100.000 

100.000 

0.650 

128 

128 

128 

100.000 

100.000 

100.000 

0.700 

128 

128 

128 

100.000 

100.000 

100.000 

0.750 

128 

128 

128 

100.000 

100.000 

100.000 

0.800 

128 

128 

128 

100.000 

100.000 

100.000 

0.850 

128 

128 

128 

100.000 

100.000 

100.000 

0.900 

128 

128 

128 

100.000 

100.000 

100.000 

0.950 

128 

128 

128 

100.000 

100.000 

100.000 

A  N  A  L  2  1 


NO.  of 
correct 
decisions 


correct 
decision 
rates (a) 


Pr (wl) 

0.050 

0.100 

0.150 

0.200 

0.250 

0.300 

0.350 

0.400 

0.450 

0.500 

0.550 

0.600 

0.650 

0.700 

0.750 

0.800 

0.850 

0.900 

0.950 


100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 


100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 


100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 


•V-V-'. 


A  N  A  L  2  2 


Pr(wl) 

O.05O 

0.100 

0.150 

0.200 

0.250 

0.300 

0.350 

0.400 

0.450 

0.500 

0.550 

0.600 

0.650 

0.700 

0.750 

0.800 

0.850 

0.900 

0.950 


NO.  of 
correct 
decisions 


lootooo 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 


correct 
decision 
rates  (7o) 

100^00 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 


c 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 


- J 


V'- 


A  N 

A 

L  3  1 

NO.  of 

correct 

correct 

decision 
rates (%) 

decisions 

Pr(wl) 

A 

B 

C 

A 

B 

C 

0.050 

128 

128 

128 

100.000 

100.000 

100.000 

0.100 

128 

128 

128 

100.000 

100.000 

100.000 

0.150 

128 

128 

128 

100.000 

100.000 

100.000 

0.200 

128 

128 

128 

100.000 

100.000 

100.000 

0.250 

128 

128 

128 

100.000 

100.000 

100.000 

0.300 

128 

128 

128 

100.000 

100.000 

100.000 

0.350 

128 

128 

128 

100.000 

100.000 

100.000 

0.400 

128 

128 

128 

100.000 

100.000 

100.000 

0.450 

128 

128 

128 

100.000 

100.000 

100.000 

0.500 

128 

128 

128 

100.000 

100.000 

100.000 

0.550 

128 

128 

128 

100.000 

100.000 

100.000 

0.600 

128 

128 

128 

100.000 

100.000 

100.000 

0.650 

128 

128 

128 

100.000 

100.000 

100.000 

0.700 

128 

128 

128 

100.000 

100.000 

100.000 

0.750 

128 

128 

128 

100.000 

100.000 

100.000 

0.800 

128 

128 

128 

100.000 

100.000 

100.000 

0.850 

128 

128 

128 

100.000 

100.000 

100.000 

0.900 

128 

128 

128 

100.000 

100.000 

100.000 

0.950 

128 

128 

128 

100.000 

100.000 

100.000 

A  N 

A 

L  3  2 

NO.  of 

correct 

correct 

decisions 

decision 
rates (%) 

Pr(wl) 

A 

B 

C 

A 

B 

c 

0.050 

128 

128 

128 

100.000 

100.000 

100.000 

0.100 

128 

128 

128 

100.000 

100.000 

100.000 

0.150 

128 

128 

128 

100.000 

100.000 

100.000 

0.200 

128 

128 

128 

100.000 

100.000 

100.000 

0.250 

128 

128 

128 

100.000 

100.000 

100.000 

0.300 

128 

128 

128 

100.000 

100.000 

100.000 

0.350 

128 

128 

128 

100.000 

100.000 

100.000 

0.400 

128 

128 

128 

100.000 

100.000 

100.000 

0.450 

128 

128 

128 

100.000 

100.000 

100.000 

0.500 

127 

127 

120 

99.219 

99.219 

93.750 

0.550 

127 

127 

120 

99.219 

99.219 

93.750 

0.600 

127 

127 

120 

99.219 

99.219 

93.750 

0.650 

127 

127 

120 

99.219 

99.219 

93.750 

0.700 

127 

127 

120 

99.219 

99.219 

93.750 

0.750 

127 

127 

120 

99.219 

99.219 

93.750 

0.800 

127 

127 

120 

99.219 

99.219 

93.750 

0.850 

127 

127 

120 

99.219 

99.219 

93.750 

0.900 

127 

127 

120 

99.219 

99.219 

93 . 750 

0.950 

127 

127 

120 

99.219 

99.219 

93.750 

A  N 

A  L  4  1 

NO.  of 

correct 

correct 

decision 

decisions 

rates (%) 

Pr (wl) 

A 

B 

C 

A 

B 

c 

0.050 

103 

108 

69 

80.469 

84.375 

53.906 

0.100 

116 

119 

83 

90.625 

92.969 

64 . 844 

0.150 

121 

123 

87 

94.531 

96.094 

67.969 

0.200 

125 

124 

92 

97.656 

96.875 

71.875 

0.250 

125 

126 

96 

97.656 

98.438 

75.000 

0.300 

125 

126 

101 

97.656 

98.438 

78.906 

0.350 

127 

126 

106 

99.219 

98.438 

82.813 

0.400 

127 

126 

108 

99.219 

98.438 

84.375 

0.450 

127 

128 

111 

99.219 

100.000 

86.719 

0.500 

128 

128 

113 

100.000 

100.000 

88.281 

0.550 

128 

128 

113 

100.000 

100.000 

88.281 

0.600 

128 

128 

114 

100.000 

100.000 

89.063 

0.650 

128 

128 

117 

100.000 

100.000 

91,406 

0.700 

128 

128 

120 

100.000 

100.000 

93.750 

0.750 

128 

128 

122 

100.000 

100.000 

95.313 

0.800 

128 

128 

124 

100.000 

100.000 

96.875 

0.850 

128 

128 

125 

100.000 

100.000 

97.656 

0.900 

128 

128 

127 

100.000 

100.000 

99.219 

0.950 

128 

128 

127 

100.000 

100.000 

99.219 

A  N 

A  L  4  2 

NO.  of 

correct 

correct 

decision 

decisions 

rates (%) 

Pr(wl) 

A 

B 

C 

A 

B 

C 

0.050 

101 

87 

127 

78.906 

67.969 

99.219 

0.100 

77 

69 

125 

60.156 

53.906 

97.656 

0.150 

63 

56 

124 

49.219 

43.750 

96.875 

0.200 

55 

50 

123 

42.969 

39.063 

96.094 

0.250 

46 

43 

122 

35.938 

33.594 

95.313 

0.300 

36 

33 

122 

28.125 

25.781 

95.313 

0.350 

29 

26 

121 

22.656 

20.313 

94.531 

0.400 

25 

21 

120 

19.531 

16.406 

93.750 

0.450 

21 

11 

119 

16.406 

8.594 

92.969 

0.500 

17 

8 

117 

13.281 

6.250 

91.406 

0.550 

12 

8 

116 

9.375 

6.250 

90.625 

0.600 

7 

7 

114 

5.469 

5.469 

89.063 

0.650 

5 

7 

112 

3.906 

5.469 

87.500 

0.700 

4 

3 

112 

3.125 

2.344 

87.500 

0.750 

3 

3 

105 

2.344 

2.344 

82.031 

0.800 

2 

1 

100 

1.563 

0.781 

78.125 

0.850 

1 

0 

93 

0.781 

0.000 

72.656 

0.900 

0 

0 

87 

0.000 

0.000 

67.969 

0.950 

0 

0 

71 

0.000 

0.000 

55.469 
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